An Affective User Interface Based on Facial Expression Recognition and Eye-Gaze Tracking
نویسندگان
چکیده
This paper describes a pipeline by which facial expression and eyegaze of the user are tracked, and then 3D facial animation is synthesized in the remote place based upon timing information of the facial and eye movement information. The system first detects a facial area within the given image and then classifies its facial expression into 7 emotional weightings. Such weighting information, transmitted to the PDA via a mobile network, is used for nonphotorealistic facial expression animation. It turns out that facial expression animation using emotional curves is more effective in expressing the timing of an expression comparing to the linear interpolation method. The emotional avatar embedded on a mobile platform has some potential in conveying emotion between peoples via Internet.
منابع مشابه
Image based recognition of gaze direction
Human{machine interfaces based on gaze recognition can greatly simplify the handling of computer applications. However, most of the existing systems have problems with changing environments and diierent users. As a solution we use (i) adaptive components which can be trained online and (ii) detect common facial features, i.e. eyes, nose and mouth, for gaze recognition. In a rst step an adaptive...
متن کاملAn Integrated Human Computer Interface using Eye Gaze Tracking and Facial Feature Recognition
متن کامل
Non-verbal Vision-based Interfaces
All computer input devices serve one essential purpose. They transduce some motion or energy from a human agent into machine useable signals. One may therefore think of input devices as the `perceptual organs' by which computers sense the intents of their human users. Since vision is the primary sense by which humans receive interaction from others, we expect computer vision to play a concomita...
متن کاملGazing into the Abyss: Real-time Gaze Estimation
Gaze and face tracking algorithms have traditionally battled a compromise between computational complexity and accuracy; the most accurate neural net algorithms cannot be implemented in real time, but less complex realtime algorithms suffer from higher error. This project seeks to better bridge that gap by improving on real-time eye and facial recognition algorithms in order to develop accurate...
متن کاملروش ردیابی چشم در تعامل انسان رایانه، بررسی فرایند تعامل برپایه داده های حرکات چشم
Nowadays most of the day today services we receive are based upon computer systems. Services such as information searching or online shopping are considered among the most frequent online information systems' services. Users assess and process the information they receive from information systems. The theory of mind information processing asserts that humans process and analyze the information ...
متن کامل